Capacity of oscillatory associative-memory networks with error-free retrieval.
نویسندگان
چکیده
Networks of coupled periodic oscillators (similar to the Kuramoto model) have been proposed as models of associative memory. However, error-free retrieval states of such oscillatory networks are typically unstable, resulting in a near zero capacity. This puts the networks at disadvantage as compared with the classical Hopfield network. Here we propose a simple remedy for this undesirable property and show rigorously that the error-free capacity of our oscillatory, associative-memory networks can be made as high as that of the Hopfield network. They can thus not only provide insights into the origin of biological memory, but can also be potentially useful for applications in information science and engineering.
منابع مشابه
Enhanced storage capacity with errors in scale-free Hopfield neural networks: An analytical study
The Hopfield model is a pioneering neural network model with associative memory retrieval. The analytical solution of the model in mean field limit revealed that memories can be retrieved without any error up to a finite storage capacity of O(N), where N is the system size. Beyond the threshold, they are completely lost. Since the introduction of the Hopfield model, the theory of neural network...
متن کاملIterative retrieval of sparsely coded associative memory patterns
We investigate the pattern completion performance of neural auto-associative memories composed of binary threshold neurons for sparsely coded binary memory patterns. Focussing on iterative retrieval, eeective threshold control strategies are introduced. These are investigated by means of computer simulation experiments and analytical treatment. To evaluate the systems performance we consider th...
متن کاملPhase Memory in Oscillatory Networks
As it was shown earlier, oscillatory networks consisting of limit-cycle oscillators interacting via complex-valued c onnec-tions can be u s e d for associative memory design. Phase memory as a special type of associative memory in oscillatory networks has been invented and studied. Detailed analysis of phase memory features of phasor networks related to oscilla-tory networks has been performed....
متن کاملFast Weight Long Short-term Memory
Associative memory using fast weights is a short-term memory mechanism that substantially improves the memory capacity and time scale of recurrent neural networks (RNNs). As recent studies introduced fast weights only to regular RNNs, it is unknown whether fast weight memory is beneficial to gated RNNs. In this work, we report a significant synergy between long short-term memory (LSTM) networks...
متن کاملRecurrent Associative Memory Network of Nonlinear Coupled Oscillators
The recurrent associative memory networks with complexvalued Hebbian matrices of connections are designed from interacting limitcycle oscillators. These oscillatory networks have peculiarities and advantages as compared to Hop eld neural network model. In particular, the class of networks with high memory characteristics (the capacity close to 1, low extraneous memory) exists. At zero values of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Physical review letters
دوره 92 10 شماره
صفحات -
تاریخ انتشار 2004